Enhancing the landing guidance of a reusable launch vehicle by improving genetic algorithm-based deep reinforcement learning using Hybrid Deterministic-Stochastic algorithm.

The PbGA-DDPG algorithm, which uses a potential-based GA-optimized reward shaping function, is a versatiledeep reinforcement learning/DRLagent that can control a vehicle in a complex environment without prior knowledge. However, when compared to an established deterministic controller, it consistently falls short in terms of landing distance accuracy. To address this issue, the HYDESTOC Hybrid Deterministic-Stochastic (a combination of DDPG/deep deterministic policy gradient and PID/proportional-integral-derivative) algorithm was introduced to improve terminal distance accuracy while keeping propellant consumption low. Results from extensive cross-validated Monte Carlo simulations show that a miss distance of less than 0.02 meters, landing speed of less than 0.4 m/s, settling time of 20 seconds or fewer, and a constant crash-free performance is achievable using this method.

Structural Optimisation and Design of a Cable-Driven Hyper-Redundant Manipulator for Confined Semi-Structured Environments.

Structural optimisation of robotic manipulators is critical for any manipulator used in confined semi-structured environments, such as in agriculture. Many robotic manipulators utilised in semi-structured environments retain the same characteristics and dimensions as those used in fully-structured industrial environments, which have been proven to experience low dexterity and singularity issues in challenging environments due to their structural limitations. When implemented in environments other than fully-structured industrial environments, conventional manipulators are liable to singularity, joint limits and workspace obstacles. This makes them inapplicable in confined semi-structured environments, as they lack the flexibility to operate dexterously in such challenging environments. In this paper, structural optimisation of a hyper-redundant cable-driven manipulator is proposed to improve its performance in semi-structured and challenging confined spaces, such as in agricultural settings. The optimisation of the manipulator design is performed in terms of its manipulability and kinematics. The lengths of the links and the joint angles are optimised to minimise any error between the actual and desired position/orientation of the end-effector in a confined semi-structured task space, as well as to provide optimal flexibility for the manipulators to generate different joint configurations for obstacle avoidance in confined environments. The results of the optimisation suggest that the use of a redundant manipulator with rigid short links can result in performance with higher dexterity in confined, semi-structured environments, such as agricultural greenhouses.

Neural network-based adaptive global sliding mode MPPT controller design for stand-alone photovoltaic systems.

The increasing energy demand and the target to reduce environmental pollution make it essential to use efficient and environment-friendly renewable energy systems. One of these systems is the Photovoltaic (PV) system which generates energy subject to variation in environmental conditions such as temperature and solar radiations. In the presence of these variations, it is necessary to extract the maximum power via the maximum power point tracking (MPPT) controller. This paper presents a nonlinear generalized global sliding mode controller (GGSMC) to harvest maximum power from a PV array using a DC-DC buck-boost converter. A feed-forward neural network (FFNN) is used to provide a reference voltage. A GGSMC is designed to track the FFNN generated reference subject to varying temperature and sunlight. The proposed control strategy, along with a modified sliding mode control, eliminates the reaching phase so that the sliding mode exists throughout the time. The system response observes no chattering and harmonic distortions. Finally, the simulation results using MATLAB/Simulink environment demonstrate the effectiveness, accuracy, and rapid tracking of the proposed control strategy. The results are compared with standard results of the nonlinear backstepping controller under abrupt changes in environmental conditions for further validation.

Arbitrary-order sliding mode-based robust control algorithm for the developing artificial pancreas mechanism.

In Diabetes Mellitus, the pancreas remains incapable of insulin administration that leads to hyperglycaemia, an escalated glycaemic concentration, which may stimulate many complications. To circumvent this situation, a closed-loop control strategy is much needed for the exogenous insulin infusion in diabetic patients. This closed-loop structure is often termed as an artificial pancreas that is generally established by the employment of different feedback control strategies. In this work, the authors have proposed an arbitrary-order sliding mode control approach for development of the said mechanism. The term, arbitrary, is exercised in the sense of its applicability to any n-order controllable canonical system. The proposed control algorithm affirms the finite-time effective stabilisation of the glucose-insulin regulatory system, at the desired level, with the alleviation of sharp fluctuations. The novelty of this work lies in the sliding manifold that incorporates indirect non-linear terms. In addition, the necessary discontinuous terms are filtered-out once before its employment to the plant, i.e. diabetic patient. The robustness, in the presence of external disturbances, i.e. meal intake is confirmed via rigorous mathematical stability analysis. In addition, the effectiveness of the proposed control strategy is ascertained by comparing the results with the standard literature.

Preload-based Starling-like control of rotary blood pumps: An in-vitro evaluation.

Due to a shortage of donor hearts, rotary left ventricular assist devices (LVADs) are used to provide mechanical circulatory support. To address the preload insensitivity of the constant speed controller (CSC) used in conventional LVADs, we developed a preload-based Starling-like controller (SLC). The SLC emulates the Starling law of the heart to maintain mean pump flow ([Formula: see text]) with respect to mean left ventricular end diastolic pressure (PLVEDm) as the feedback signal. The SLC and CSC were compared using a mock circulation loop to assess their capacity to increase cardiac output during mild exercise while avoiding ventricular suction (marked by a negative PLVEDm) and maintaining circulatory stability during blood loss and severe reductions in left ventricular contractility (LVC). The root mean squared hemodynamic deviation (RMSHD) metric was used to assess the clinical acceptability of each controller based on pre-defined hemodynamic limits. We also compared the in-silico results from our previously published paper with our in-vitro outcomes. In the exercise simulation, the SLC increased [Formula: see text] by 37%, compared to only 17% with the CSC. During blood loss, the SLC maintained a better safety margin against left ventricular suction with PLVEDm of 2.7 mmHg compared to -0.1 mmHg for CSC. A transition to reduced LVC resulted in decreased mean arterial pressure (MAP) and [Formula: see text] with CSC, whilst the SLC maintained MAP and [Formula: see text]. The results were associated with a much lower RMSHD value with SLC (70.3%) compared to CSC (225.5%), demonstrating improved capacity of the SLC to compensate for the varying cardiac demand during profound circulatory changes. In-vitro and in-silico results demonstrated similar trends to the simulated changes in patient state however the magnitude of hemodynamic changes were different, thus justifying the progression to in-vitro evaluation.

Robust stabilization of underactuated nonlinear systems: A fast terminal sliding mode approach.

This paper presents a fast terminal sliding mode based control design strategy for a class of uncertain underactuated nonlinear systems. Strategically, this development encompasses those electro-mechanical underactuated systems which can be transformed into the so-called regular form. The novelty of the proposed technique lies in the hierarchical development of a fast terminal sliding attractor design for the considered class. Having established sliding mode along the designed manifold, the close loop dynamics become finite time stable which, consequently, result in high precision. In addition, the adverse effects of the chattering phenomenon are reduced via strong reachability condition and the robustness of the system against uncertainties is confirmed theoretically. A simulation as well as experimental study of an inverted pendulum is presented to demonstrate the applicability of the proposed technique.

Integrated modeling and design for realizing a two-wheeled wheelchair for disabled.

Two-wheeled wheelchairs are considered highly nonlinear and complex systems. The systems mimic a double-inverted pendulum scenario and will provide better maneuverability in confined spaces and also to reach higher level of height for pick and place tasks. The challenge resides in modeling and control of the two-wheeled wheelchair to perform comparably to a normal four-wheeled wheelchair. Most common modeling techniques have been accomplished by researchers utilizing the basic Newton's Laws of motion and some have used 3D tools to model the system where the models are much more theoretical and quite far from the practical implementation. This article is aimed at closing the gap between the conventional mathematical modeling approaches where the integrated 3D modeling approach with validation on the actual hardware implementation was conducted. To achieve this, both nonlinear and a linearized model in terms of state space model were obtained from the mathematical model of the system for analysis and, thereafter, a 3D virtual prototype of the wheelchair was developed, simulated, and analyzed. This has increased the confidence level for the proposed platform and facilitated the actual hardware implementation of the two-wheeled wheelchair. Results show that the prototype developed and tested has successfully worked within the specific requirements established.

Preload-based starling-like control for rotary blood pumps: numerical comparison with pulsatility control and constant speed operation.

In this study, we evaluate a preload-based Starling-like controller for implantable rotary blood pumps (IRBPs) using left ventricular end-diastolic pressure (PLVED) as the feedback variable. Simulations are conducted using a validated mathematical model. The controller emulates the response of the natural left ventricle (LV) to changes in PLVED. We report the performance of the preload-based Starling-like controller in comparison with our recently designed pulsatility controller and constant speed operation. In handling the transition from a baseline state to test states, which include vigorous exercise, blood loss and a major reduction in the LV contractility (LVC), the preload controller outperformed pulsatility control and constant speed operation in all three test scenarios. In exercise, preload-control achieved an increase of 54% in mean pump flow ([Formula: see text]) with minimum loading on the LV, while pulsatility control achieved only a 5% increase in flow and a decrease in mean pump speed. In a hemorrhage scenario, the preload control maintained the greatest safety margin against LV suction. PLVED for the preload controller was 4.9 mmHg, compared with 0.4 mmHg for the pulsatility controller and 0.2 mmHg for the constant speed mode. This was associated with an adequate mean arterial pressure (MAP) of 84 mmHg. In transition to low LVC, [Formula: see text] for preload control remained constant at 5.22 L/min with a PLVED of 8.0 mmHg. With regards to pulsatility control, [Formula: see text] fell to the nonviable level of 2.4 L/min with an associated PLVED of 16 mmHg and a MAP of 55 mmHg. Consequently, pulsatility control was deemed inferior to constant speed mode with a PLVED of 11 mmHg and a [Formula: see text] of 5.13 L/min in low LVC scenario. We conclude that pulsatility control imposes a danger to the patient in the severely reduced LVC scenario, which can be overcome by using a preload-based Starling-like control approach.

Hemodynamic response to exercise and head-up tilt of patients implanted with a rotary blood pump: a computational modeling study.

The present study investigates the response of implantable rotary blood pump (IRBP)-assisted patients to exercise and head-up tilt (HUT), as well as the effect of alterations in the model parameter values on this response, using validated numerical models. Furthermore, we comparatively evaluate the performance of a number of previously proposed physiologically responsive controllers, including constant speed, constant flow pulsatility index (PI), constant average pressure difference between the aorta and the left atrium, constant average differential pump pressure, constant ratio between mean pump flow and pump flow pulsatility (ratioP I or linear Starling-like control), as well as constant left atrial pressure ( P l a ¯ ) control, with regard to their ability to increase cardiac output during exercise while maintaining circulatory stability upon HUT. Although native cardiac output increases automatically during exercise, increasing pump speed was able to further improve total cardiac output and reduce elevated filling pressures. At the same time, reduced venous return associated with upright posture was not shown to induce left ventricular (LV) suction. Although P l a ¯ control outperformed other control modes in its ability to increase cardiac output during exercise, it caused a fall in the mean arterial pressure upon HUT, which may cause postural hypotension or patient discomfort. To the contrary, maintaining constant average pressure difference between the aorta and the left atrium demonstrated superior performance in both exercise and HUT scenarios. Due to their strong dependence on the pump operating point, PI and ratioPI control performed poorly during exercise and HUT. Our simulation results also highlighted the importance of the baroreflex mechanism in determining the response of the IRBP-assisted patients to exercise and postural changes, where desensitized reflex response attenuated the percentage increase in cardiac output during exercise and substantially reduced the arterial pressure upon HUT.